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THE  FINDINGS  IN  THIS  REPORT  ARE  NOT  TO  BE 
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ARMY  POSITION,  UNLESS  SO  DESIGNATED  BY  OTHER 
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Abstract 


Tong  [9]  proposed  an  adaptive  approach  as  an  alternative  to  the  classical 
indifference- zone  formulation  of  the  problems  of  ranking  and  selection.  With 
a  fixed  pre-selected  y*  (1/k  <  y*  <  1)  his  procedure  calls  for  the  termi¬ 
nation  of  vector-at-a-time  sampling  when  the  estimated  probability  of  a  correct 
selection  exceeds  Y*  for  the  first  time.  The  purpose  of  this  note  is  to  show 
that  for  the  case  of  two  normal  populations  with  common  known  variance,  the 
expected  number  of  vector-observations  required  by  Tong’s  procedure  to  terminate 
sampling  approaches  infinity  as  the  two  population  means  approach  equality  for 
Y*  i  *  0.8413.  This  phenomenon  presumably  also  persists  if  the  two  largest  of 
k  £  3  population  means  approach  equality.  Since  in  the  typical  ranking  and 
selection  setting  it  usually  is  assumed  that  the  experimenter  has  no  knowledge 
concerning  the  differences  between  the  population  means,  the  experimenter  who 
uses  Tong’s  procedure  clearly  does  so  at  his  own  risk. 


1.  Introduction.  We  retain  the  notation  of  Tong  [9]  and  consider  the  important 
case  of  Section  5  of  his  paper,  namely  that  of  the  normal  family.  Here 


(X  }  are  i.i.d.  normal  r.v.'s  with  means  0^  (1  <  i  ^  k)  and  common  known 

variance  o  .  For  every  n  (n  =  1,2,...)  let  X;  =  —  £  X..  (1  ^  i  <  k), 

and  denote  the  ordered  sample  means  by  x£”j  <...<  x£”]* 

_  s(n)  _  7<n)  -^Kn) 


j=l 

Define 


6i  5  6i  '  ADO  "  A[iJ 


x;;:;  -  x^;;  (1  <  i  <  k-i),  and 


x  1/2- 
H  *(y  +  n  '  $./a)d*(y), 

i=l  1 


(1) 


the  latter  being  an  estimate  of  the  probability  of  a  correct  selection  (PCS) 

at  stage  n.  (See  Gibbons,  Olkin,  and  Sobel  [5],  Section  2.3.4.)  Here  $(•) 

is  the  standard  normal  cdf,  Tong’s  primary  procedure,  R^,  stops  at  the 

first  stage  that  y ^  £  y*  where  y*  (1/k  <  y*  <  1)  is  a  pre-selected 

constant,  analogous  to  P*  in  the  classical  indifference-zone  formulation  of 

A  ( n ) 

Bechhofer  [1].  Thus  the  stopping  stage  for  is  -  inf{n:  y^  >  y*l 


where  the  infimum  of  the  empty  set  is  defined  to  be  +®. 

Denoting  the  ordered  values  of  the  0^  by  8^-j  <...<  Tong  [9] 

proved  for  arbitrary  ^  =  (0^,...,0^)  with  0^  <  that  asymptotically 

(y*  -►  1)  vre  have  *v  n*  where  n*  =  n*(£)  is  smallest  single-stage 

sample  size  that  achieves  a  PCS  of  y*  for  that  If  is  more  (less) 

favorable  to  the  experimenter  than  and  n*  was  chosen  under  the  assumption 
that  £  is  the  true  state  of  nature,  then  one  would  anticipate  that 

<  n*(>  n*).  In  particular,  when  0[fc..i]  =  one  anticipate 

that  »  n*.  In  Section  2  we  prove  for  k  =  2  that 

actually  infinite  when  0^^  =  0^2^  and  y*  is  moderately  large. 
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2.  The  case  of  k  =  2  normal  populations 

Our  result  is  summarized  in  the  following  theorem: 


Theorem:  For  k  =  2  and  8^  =  ®[2]’  the  r,w'  Ni  =  inf^n:  \  iY*) 

has  E.{N^}  =  *  when  #”^(y*)  >,  1. 

% 

Remark  2.1:  *-1(y*)  >,  1  for  y*  ^  *(1)  ^  0.8413.  Hence,  for  y*  ^  *(1) 

we  have  E^{N^}  "*■  •  as  8^  -  8^  ■*  0. 


Proof:  For  k  -  2  normal  populations  we  can  write  (1)  as 


Y^  =  /  *(y  +  n^^/oMtty) 


(2) 


Then 


inf{n: 


>  /SI  ♦*1(y*)>.  Since  ^  =  |x^n)  -  X^n)| 

=  inf{n:  |  l  (X..  -  X_.)//2o|  >  n1/2*_1(Y*) > 
j=l  A3 

=  inf{n:  |S  |  >  y*) } 

n  ■* 


we  see  that 


where  for  0,-0,,  we  have  that  S  is  the  sum  of 
1  2.  n 

By  Corollory  1  of  Chow,  Robbins  and  Teicher  [3],  p. 
is  infinite  for  ♦  ^(y*)  £  It  i.e.,  for  y*  £  ♦(!) 
theorem  is  proved. 


n  i.i.d.  N( 0 , 1)  r.v. 
792,  we  see  that  E{N^} 
^  0.8413,  and  thus  the 


s. 
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Reroark  2.2;  The  same  result  holds  for  Tong’s  procedure  R2  since  R2 
stops  after  R^ . 


3.  Comparisons  of  E{N^}  with  the  corresponding  quantity  for  other  competing 
procedures 

In  the  setting  of  Section  1  with  k  >  2,  the  expected  number  of  stages 
required  to  terminate  experimentation  for  three  other  sequential  procedures 
are  compared  with  the  corresponding  quantity  for  Tong’s  R^.  The  procedures 
are  the  closed  sequential  procedure  (with  elimination)  of  Paulson  [6]  (with 
the  improvement  of  Fabian  [4]),  the  open  sequential  procedure  (without 
elimination)  of  Bechhofer,  Kiefer,  and  Sobel  [2],  p.  264,  and  the  two-stage 
procedure  (with  elimination)  of  Tamhane  and  Bechhofer  [7],  [8];  all  of  these 
procedures  are  known  to  guarantee  the  indifference-zone  probability  require¬ 
ment  for  all  k  ^  2  and  specified  {&**  P*}  (0  <  <S*  <  •,  1/k  <  P*  <  1). 

For  Paulson’s  procedure  the  number  of  stages  is  bounded.  For  the  Bechhofer- 
Kiefer-Sobel  procedure  the  expected  number  of  stages  for  k  =  2  has  been 
proven  to  be  bounded  ([2],  p.  224);  for  this  procedure  with  k  ^  2  and 
(*[1]  =  an  excellent  approximation  (P*  1)  supported  by  Monte  Carlo 

sampling  results  is  available  for  the  expected  number  of  stages  ([2],  pp.  296-7). 
For  the  Tamhane-Bechhofer  procedure  the  number  of  vector-observations  is 
bounded  (and  the  expected  total  number  of  observations  required  to  terminate 
experimentation  is  uniformly  in  £  less  than  the  total  number  required  by 
the  corresponding  single-stage  procedure  of  Bechhofer  [1]). 

In  view  of  the  desirable  properties  of  the  above  procedures  there  appears 


to  be  little  justification  for  using  Tong’s  procedure. 
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